On confidence intervals for GAMs based on penalized regression splines
نویسنده
چکیده
Generalized additive models represented using penalized regression splines, estimated by penalized likelihood maximisation and with smoothness selected by generalized cross validation or similar criteria, provide a computationally efficient general framework for practical smooth modelling. Various authors have proposed approximate Bayesian interval estimates for such models, based on extensions of Silverman’s (1985) re-derivation of the intervals proposed by Wahba (1983) for smoothing spline models of Gaussian data, but testing of such intervals has been rather limited and there is little supporting theory for the approximations used in the generalized case. This paper aims to improve this situation by providing simulation tests and obtaining asymptotic results supporting the approximations employed for the generalized case. The paper also suggests a simple and efficient simulation scheme for dealing with the poor interval coverage that can sometimes result from conditioning on smoothing parameter estimates.
منابع مشابه
GAMs with integrated model selection using penalized regression splines and applications to environmental modelling
Generalized Additive Models (GAMs) have been popularized by the work of Hastie and Tibshirani (1990) and the availability of user friendly GAM software in Splus. However, whilst it is flexible and efficient, the GAM framework based on backfitting with linear smoothers presents some difficulties when it comes to model selection and inference. On the other hand, the mathematically elegant work of...
متن کاملGeneralized additive models in business and economics
The paper presents applications of a class of semi-parametric models called generalized additive models (GAMs) to several business and economic datasets. Applications include analysis of wage-education relationship, brand choice, and number of trips to a doctor’s office. The dependent variable may be continuous, categorical or count. These semiparametric models are flexible and robust extension...
متن کاملThin plate regression splines
I discuss the production of low rank smoothers for d ≥ 1 dimensional data, which can be fitted by regression or penalized regression methods. The smoothers are constructed by a simple transformation and truncation of the basis that arises from the solution of the thinplate spline smoothing problem, and are optimal in the sense that the truncation is designed to result in the minimum possible pe...
متن کاملBootstrap Confidence Intervals for Smoothing Splines and Their Comparison to Bayesian Confidence Intervals
We construct bootstrap confidence intervals for smoothing spline and smoothing spline ANOVA estimates based on Gaussian data, and penalized likelihood smoothing spline estimates based on data from exponential families. Several variations of bootstrap confidence intervals are considered and compared. We find that the commonly used bootstrap percentile intervals are inferior to the T intervals an...
متن کاملSpatially Adaptive Bayesian Penalized Regression Splines (P-splines)
In this paper we study penalized regression splines (P-splines), which are low–order basis splines with a penalty to avoid undersmoothing. Such P–splines are typically not spatially adaptive, and hence can have trouble when functions are varying rapidly. Our approach is to model the penalty parameter inherent in the P–spline method as a heteroscedastic regression function. We develop a full Bay...
متن کامل